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FOREWORD 



What follows is designed to provide an overview of the 1979 Illinois 
Inventory of Educational Progress (HEP) in eleventh grade mathematics. The 
test has been administered by the Illinois State BoarcLof Education since ' 
1976; however, this analytical report ts in a new and more usable format, 

« * , - 
Development of th$ HEP is discussed, and results and analyses of the test 
administered to eleventh grade students are presented, • Results and analyses 
of fourth and eighth grade tests can be found in separate reports. It is 
hoped that the informatioh Contained here will enhance instruction in 
Illinois schools. * ^ 

e 

While many state staff . members contributed to the preparation* of this 
report, I would like to especially acknowledge the efforts of Dr. Mervin M. 
Brennan as the main writer. Ally questions concerning this report may be 
addressed to Dr. Brennan or Or. Thomas x Kerins-, t Manager of the program 
Evaluation .and Assessment Section of the Department of Planning, Research 
and Evaluation of the .Illinois State Board of Education. 




, Donald G. Gill 

& v$tate Superintendent of Education 



* ; PREFACE : 

* * * 

Purpose * . 

The Illinois Inventory of Educational Progress* (IIEP)-is a systematic effort 
by the Illinois State Board of Education to collect information on the 
educational achievement of Illinois students in' certain .areas and to make 
that information available to educational decisiofi makers. 

The three goals* of the HEP are: • % . 

*• * • 

1) to make SVailabfe relevant, reliable, and valid data on the educational 
attainments of Illinois students; 

•2) to identify any trends (growth, stability, or decline) in educational 
attainments which occur over time; and , 
* » v 

3\ to publish results of the Research =concjucted in connection with the HEP. 

-Student Selection ' * * 

A random sample with two saipling stages is used to select those students, 
attending Illinois public schools who will participate. 

First, schools throughout the* state are chosen randomly. A sample of 
fourth, eighth? and eleventh graders is then randomly selected from lists of 
eligible students submitted by schools for participation. These'grade 
levels are selected to correspond roughly with the 6nd of the primary, 
elementary, Aand- secondary levels of education.. * r ^ . 

Since the HEP is o^red toward determining how groups of Illinois students 
perform on given rasks, no individual student, teacher, school, or district 
is identified in any reports of the results. . 

Type of Test * \ > . -? v 

The HEP employs an objective-referenced approach. An objective-referenced 
^asse^ment instrument assesses 'student performance.. Desired student 
performance i£ expressed in terms of objectives. An objective is a 
statement of desired student performance, for example: "Fourth grade 
students should be able to recognize geometric shapes such as circles,* 
etc." 'Student performance is measured by test items designed to determine 
whether or not certain groups of students are able to do what the objective? 
state they' should be able to do. " * . 

Subject Areas • 

The IIEP has been % existence since 1976. A nlirtber* of subject area^have 
been .assessed, for example, reading; mathematics, science, citizenship, 
energy and nutrition, ..as well- as .student attitudes about themselves and 
education in general. * v * . * 

*> » 

Base line d'ata^is collected during the first year that any subject area is v 
asse'ssed. For eSich succeeding year* that a subject area is reassessed, 
comparisons can be made concerning studeht performance on specific 
objectives, and any growth or decline in achievement can be noted/ • 
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•CHAPTER 1 



Illinois Inventory of- Educational- Progress - Mathematics 
Development of the 1979 Mathematics-IIEP 

In the spring of 1978, a panel of six. mathematics educators with elementary, 
junior high, high school and college teaching and. administrative experience 
was convened 'to assist State Board staff in formulating the 1979 mathematics 
HEP (a roster of panel . members appears in Appendix D). Charged with 
redrafting the objectives which, had been developed for the 1976 IIEP, the 
group met pver a two-jj»onth period. The* results of their work are discussed- 
later in this report. . •. 

Additionally,' results of a teacher survey that was -adninistered with the 
previous year's HEP (1978) were used in developing the 1979 mathematics 
HEP. Produced by State Board staff, the survey sought to: (1) validate 
the test; (2) supply an additional perspective on the results; and (3) 
provide a standard of performance, based upon teacher estimates, with which 
student results could be compared^ . • 

Toward that end, one mathematics teacher from each school which participated 
in the 4 HEP was asked to do three things for each test item. Teachers were 
asked .to determine (1) whether students had been exposed to the material and 
^(2) whether the item was of an appropriate levelof difficulty. Teachers 
were 'also/ asked (3) to .estimate the percentage of students that could be, 
expected* to answer each item correctly. A sample of the teacher survey is 
contained in Appendix C. Results of the teacher survey are discussed in 
Chapter 2. > . 

The Test ■ * . 

The 1 test was a domain and objective-referenced test, which means simply th 
the items tested the general domain of mathematics and that items are' 
derived from or keyed to a set of curricular objectives. 

Mathematics objectives fpr the 1979 HEP were developed by the 
aforementioned panel of/educators. The following mathematics topics and 
abilities reflect thoSe objectives. A list of topics precedes a summary 
description of abilities. Some. of the topics are self-explanatory; a brief 
definition is provided for those which. are less common.. The abilities are a 
bit more detailed;' essentially, they are the skills required for success in. 
mathematics. Each mathematics objective describes .a particular .ability with 
reference tea specific topic. 



Mathematics Topics - , 

I. NUMERATION CONCEPTS.: This topic refers to' the concepts of 

humeration amj place. value, and the processes of naming numerals, t 
approximating numbers, and rounding off numbers. 

K II. PROPERTIES OF NUMBERS AND OPERATIONS. This topic also includes t 
^characteristics of numbers and operations and comparisons among 
numbers. 

III. NUMBERS. ' 

A. . WHOLE NUMBERS. Whole nuftbers are the humbers used by children 

to count. Whole numbers include 0, 1, 2^ 3, etc. 

• \ 

B. FRACTIONS. • 

C. DECIMALS. 
0. PERCENT. ' 

E. INTEGERS. Integers ire positive and negative whole numbers 
and zero as distinguished from fractions. The numbers ^3, -2, 
-1, 0, +1, +2, +3, etc;, are'integers. 

. <*> 

F. RATIONALS. Rattonals is an all-inclusive term for topics- A 
through E, both positive and negative. Examples. are +2, +1/2, 

. • +.50, +50%, -2, -1/2, -.50, and -50%. 

' " i / 

G. '~ REALS. Reals is an all-inclusive term for topics A through F , 

afid numbers such as if , y^T, etc - 

* 

IV. * MEASUREMENT. ' 

* • x 

♦V. ALGEBRA. 
VI. GEOMETRY. , 
VII. PROBABILITY AND STATISTICS. 
VIII. PERSONAL AND CONSUMER MATHEMATICS. • 



Mathematics Abilities 

1. . Ability to recall and recogrwze tacts, definitions, and symbols 

quickly. Perception is the ^ primary mental act used. , * ^ 



2. , Ability to perform computations, procedures, and Complex counting 

where the operations are indicated. 

3. Ability to understand concepts, fac£s, and processers. The mental 
operations of analysis and synthesis are used to make comparisons 
and evaluative judgments. 



4. Ability to solve complex word problems. . Several of the following 
operations must be involved: interpretation of the question, 
/ - identification of the relevant data from the given information, 

decision^ about which operations need 'to be performed on the data, 
• correct performance on the operations, and interpretations of the 
results. 

Each mathematics item tested a student ability with respect to one of the 
mathematics topics. The matrix of mathematics topics and abilities (Table 
1) shows the conceptual model of the HEP mathematics tests. Each cell of 
the- matrix is a specific mathematics objective. 

The test contained items on nine topics' and four abilities. There were 
items retetechto 15 objectives within the topics and abilities. A topic, 
ability, or .pBjective was considered to-be measured if there were three or 
more items testing it. By that standard the test measured' seven topics, 
four abilities, and six objectives within them. . The test is described more 
fully in subsequent chapters of thj.s report. 



\ 



' Table 1 
1 MATRIX OF MATHEMATICS OBJECTIVES 

MATHEMATICS CATEGORIES, BY ABILITIES 

Mathematics Abilities 



1 

Ability to t 
recall and. 
recognize facts, 
definitions, and 
symbols* quickly 



> 

Mat hen 


fattcs Topics x 




* 




MIIMCD ATTOM POMPCDTC 

NUMtKAl IUN LUNLtr lo 






^11. 


PROP to ES OF NUMBERS 








AND OPERATIONS 


5 


• 4, 8 


III. 


NUMBERS 








A. WHOLE NUMBERS 


9 






B. FRACTIONS 


T3 


8 




C. DECIMALS 


w 






D. PERCENT 








E.. INTEGERS 


w 






F. RATIONALS 


29- 


8 




6. REALS 


33 




IV. 


MEASUREMENT 


37 


4, 8 


• 




11 * 


V! 


ALGEBRA 


41 . 




VI. 


GEOMETRY. 


n 


8 . 


VII. 


PROBABILITY AND 






"VIII. 


STATISTICS 


49 




PERSONAL AND .CONSUMER 








MATHEMATICS 


53 


• 4-' 



Ability to 
perform * ' 
computations, 
procedures, and 
complex counting 
where the 
operations are 
indicated • * 



2 

6- 



10 
IT 

H 
22 

H* 
30 

38, 

42 
M 

50 

54 



4, 8, 11 

n ' 

8 
8 

4, 8 

vll 



8, 11 
8, 11 



11 

4, 8 



"3 i ^ , 

Ability to 
understand 
j concepts, 
facts, and 
processes 



3/8 
.7 "4 



11 

15 

M 
23 

27 
3T 
35 

39. 

43 
47 

51 

55. 



8 
11 



11 
8 

'8, 11 



Ability to 
S;olve- complex 
word problems 



i 

t 



4 

8 



8 
4 



12 
T6" 
15 
24 

H 8, 11 
32 8, 11 
36 



4, 8 
11 



40 
44 

J8 11 - 
52 

56- 4,. 8, 11 



* The numerals (4* 8, 
• 1979 HEP. 



11) indicate the grade level (s) at which these items were tested )n the 



Chapter 2* 
* ITEM RESULTS 



As mentioned in Chapter .1, teachers of participating students were asked to 
estimate the percentage of students who would obtain the correct answers to 
the items. The hypothesis was that the teacher estimates would be higher 
than the s-tudent scores. Chapter 4 Shows the statistical results. , . 

It was anticipated that there wo.uld be some^discrepancies between teacher 
estimates arid-jstudent scores which could not be" submitted to statistical 
Itests or would nat reach significance levels, but would lend themselves, to 
suggestions for future research. After statistical analysis of the data, 
"experienced Illinois mathematics educators were asked to comment on the 
results. ' 

The following descriptions were used for discrepancies between teacher 
estimates and student scores:- . 

t 

approximating for discrepancies of ten or less percentage points, 

higher than/lower than for discrepancies of 11 to 20 points, and" 

considerably higher than/lower than for discrepancies of more than 
20 points. ' v 

These dis«repancy guidelines were established because consultants suggested 
the use of consistent- standards. Ten percentage points was used since 
' standard'deviations for previously calculated data were usually near .10. 

, The panel of mathematics educators was asked to analyze and' interpret the 
test results using the test data and the teacher survey data. They 
reflected upon, the data for each curricular topic and each objective within 
the topics, this chapter gives the data and the panel's comments. Correct ■ 
answers" are underlined. Xeacher estimates are abbreviated as teach, est-., 
student scores are abbreviated as stu. score . v \ 

The comments are solely those of the experts and are- not to be taken as -the 
official position of the State Superintendent of Education or the Illinois 
State Board, of Education . • & ' 

l< Topic I: Numeration Concepts and 

-^Topic to: Properties of Numbers and Operations 



The mathematics panel decided during the test development phase that Topics I 
and TI (objectives 1-S) were of lower priority than other topics for an - - - 
eleventh. grade test. Neither topic\was tested in the 1979 HEP. 



Topic f II s Numbers • * 

' • ' \ . ' - 

Fifteen items, more than oneHhird of the test, measured this topic. There 
were foiir items on whole numbers, seven on fractions, three ^pn rationals, and 
one on integers. 

n • — 

\» » 

Whole Numbers All four items on this topic tested computation. Jabje 2 shows 
the results. 



Table 2 . - 



\ 



Objective 10: Computation with Whole Numbers * 
Item 25. 3(2. + 7) * 



a. 


6 


b. 


12 


c. 


13 


d. 


23 


e. 


27 



teach, est.:. 81% 
, stu. score: 80%* 



Item 34. What t is the SMALLEST 'number that can be 
divided by 3, 6, and 9 without a remainder? v 



a. * 

b. 12 teach, est.: 78% 

c. 18 * v stu. score:. 77? 

d. 36 * 



Item 24. 2037 
x82 



a. 167,770 „ <- 

bf 194,334 ■ teach, est.: 8*% 

c. 230,034 stu. score:- 73% 

d. 167,034 ' . , . 



Item 36/ Wbich of the following is t equal to 2^? 
«• 

... .5 '" 3 

b. . 6 ■ ' teaph. est.: *7% 

c. 8 * stu. score: 72% 
T. ? . - 

e. J6 ' . ~ 



Panel comments : The student average score for objective 10 (761 correct) 
approximated the teacher estimate (78% correct). Students scored above 705! on 
all four items. 



Fractl ons. 



Six items measured student ability to compute with fractions. One item tested 
student ability to understand fractions. Table 3 shows the results'. 



Table 3 



Objective 141 Computation with Fractions 



Item 33. 1/2 x 1/4 = 



a. 1/6 

b. 1/8 



276 
2/8 



.teach', est.: ,83X 
stu. score: 75* 



Item 29. 2 2/3 = 



a. 2/5 

b. 4/6 

c. 4/5 

d. 4/3 

e. 8/3 



teach, est.: 83% 
stu. score: 74% 



Item 28. Which of the following pa4rs of fractions 
are equivalent? -' 



a. 5/8 and 2/3 

b. 5/6. and 2/3 

c. 4/5 and 14/15 

d. 3/S and 9/15 
T. 1/2 and 14/24 



teach, est.: '74% 
stu. score: 1z% 



Item 31. 1/2 +'1/3 = 



a. 1/5 

b. 2/6 
c 4/5 
d. 5/6 



teach, est.: 74% 
stu. score: 55% 



Item 32. 1 2/5 - 1/2 = 



a. 
b. 



c. 
d. 
e. 



2/3 
9/10 

Tim 

1.1/7 
1 ,1/3* 



teach, est.: 67% 
stu. score: '5^% 



Item 30. Which fraction is the GREATEST? 



a. 2/3 

b. "-'3/4 

c. 4/5 v 

T — 575 




teach. est.: v ^69% 
stci. score: 41% 



Objective 15: /Understanding of Fractions 

Item 40. There are 13 t>oys and 15 girls in a group. 
What fractional part' of the group fs boys? 



* a. 13/15 
hi . ' 13/26 

c. ,15/28. 

d. *; 13/28/ 



teach, est.: 70% 
stu. score: 52% 



Panef comment's ^ Student scores were significantly lower than the teacher \ 
estimates on computations with fractions (p < .05), and lower than the 
teacher estimate for understanding of fractions (See Table 13 for average ■ t 
teachei- estimate and student scores). The student score was -higher for the. 
fraction multiplication item than for the fraction addition and subtraction 
items. Scores were also higher for tlje items requiring. identification of 
equivalent fractions and conversion of a mixed number to a fraction (solution 
processes- apparently known by students), than for conversions of four . 
fractions to a common scale for size, comparisons (a solution process which.may 
Tbe known by fewer students). '"*•*. % 



Inteqegs- • * 

i 

The. test contained one item on 'integers. Table 4 shows the results, 



5 , 



Table 4 



Results for .the Integer Item 



/'Objective 28: Problem Solving with Integers ' 



Item 37. The air temperature on the ground is 31 
degrees* On top of a nearby mountain, the temperature 
is* -7 degrees* How many degrees difference is there 
between these two temperatures? 



a. 24 degrees 

b. 4 3/7 degrees ^ , teach, est.: 72% 

c. 31 /degrees - stu. score: 66% 

d. 38 degrees . 



Panel commertts : This is a real -life problem with which most students are 
probably familiar. The student score approximated the teacher estimate. 



Rationals There were three items on rationals. E^ch item tested a different 
student ability. Table 5 shows the results. 



1 * 



Table 5 



Objective 30: Computation with Rationals 



Item 26.^ 3/5 = 1 ' . 



a. 6 percent 

b. 15 percent ' teach, est,: 70% 

c. ^ 23 percent stu. score: 53% 
, d/ .30' percent 

e. 60 percent 



Objective 31: Understanding of Rationals 



Item'27* What fraction 'of $1 is 20 cents? 



a. 1/20 

b. * 1/9 ' , teacti^ est, : 74% 

c. 1/5 stu. score: 70% 

d. I 1/4 

e. 1/2 ■ * 



V 



Objective 32: Problem Solving with Rational s 



.Item 38.* Using a scale of 1 yard = 1/2 inch t a 
' drawing of a swimming pool 25 yards long is mate. How 
manyMnches'will the length of the pool take up in the 
drawing? 



a. 12 1/2 ■ 

b* i 20 teach, est.: 64% 

S ?5 • I stu. score: 82% 

d. 25'l/2 ■ - ' . . 



fane! comments :^ Student scores were highest for the problem-solving item 
(item 38), somewhat lower for the item related to understanding of rationals- 
(item 27), and lowest for the computation item (item 26). These results led 
* ^to several thoughts and suggestions. The items themselves seemed to vary from 
concrete to abstract. Also, students* could have seen them as varying from 
being real-life and practical to purely academic. It was suggested that 
considerable research needs to be done to. identify what difficulties are 
inherent in the mathematics of ratipnals. The perceptions of students as they 
. attempt these types of items should also be investigated. 



Topic JV: Measurement 



Ten items (25%) af the total test assessed student -abilities in«regard to 
mathematical measurement. Four items tested recognition of measurement facts, 
one item was on computation in measurement, and fiv,e items measured problem fc 
solving. Table 6 shows, the results. 



Table 6 



Measurement Items^and Results 



.Objective '37: Recognition of Measurement Facts 



Item 53. Jn the United States, we usually buy 
gasoline 6y the gallon. In France, where the metric 
system is used, people buy gasoline by the. 



• -a. meter. 
v b^ liter. 



quarfc. 
gram. . 



teach, est.: 67% 
stu. score: 88% 



Item 54*. In the United States, we usually buy 
potatoes » by the pound. In Germany, wh&re the metric ^ 
system is, used,, people buy potatoes by^the 



a. meter. 

b. .liter, 

c. pound./ 

d. kilogram. 



teach, 'est.: - 70% 
stu/ score: 84% 



Item 55* Which- '1s the closest to the size of one 
cm 2 ? , > . 



a. r A -tennis court 

b. Your thumbnail teach, est.: 63% 
c^ A slice of bread* stu. score: _ 76% 

* d. The cover of a record. album ' „ 



18 - .f 

- 12 - 



Item 62. The perimeter of a square could be measured 
in ^ 



"a. square centimeters. 

b. liters. teach, est.: 59% 

c. . degrees Celsius. stu. score: 42% 

d. grams. 

e. meters . 



Objective 38: Computation in Measurement 



Item 56. About how long is the paper clip above the 
metric ruler? 




t ^ M p > c i ^ - ^ t ■ p ; 1 i | ■ < H 1 1 ^ 1 , 1 1 > 1 1 1 i . 1 1 1 1 1 1 f 1 1 M f 1 1 1 M j I i i 1 1 M ) 1 1 i * . 1 1 M ( 1 1 M 1 1 j> i i 1 1 M 1 1 1 1 ( t , 1 1 
6cm 1 2 3 4 5 6 1 * • * 10 



a. 30 mm 

Fi 30 cm .teach, est.: 70% 

'c. 3 ml ' . . stu. score: 59% 

d. 3 km . . 



Objective 40: ^Problem Solving in-Measuremejit 

Item 41. What is the volume of a box jtthh a width of 
9 cm, a length of 12 cm and a heifft-t # 25 cm? 

a. 46 qn* . 

b. 460 cm 3 - teach, est.: 66% 
a. 270 cm 3 ( stu. score: 54% 

d. 525 cm 3 

e. 2700 cm 3 



Item 60. At four o'clock, , the, size of the angle 
> between -the minute hand and the hour hand of a clock is- 



a. 45 degrees. 

b. 60 degrees. . ; teach, est.: 51% 

c. 90 degrees. stu. score: 51% 

d. 120 degrees . < \ 
e^ 150 degrees. . 

a 

Item -50. A car takes 15 mindtes to travel ten 
kilometers. What is the, speed of the car? 

«* • 

a. 30 kilometers per hour 

b. 40 kilometers per hour teach, est.: 56% 
"c^ 60 kilometers per hour a stu. score: . 48% 

d. 90 kilometers p ? er hour « 1 ' _ # • 

e. 150 kilometers per hour 

Item 45. Mr. Johnson wants to buy_carpeting for his 
living room. *The room is square and has a perimeter 
of 56 feet. What is the a^ea of the room in sqtiare 
feet? * * 



a. . 144 square feet 

b. . 169 square feet 
182 square feet 
196 square feet 



c 



teach, est.: 53% 
stu. score: 44% 



Item 52. A runner ran -3,000 meters, in exactly eight 
minutes. What was the average speed? 



a. 3.75 meters per second 

b. , 6.25 .meters per second 
c^ 16.0 meters per second 

d. 37.5 meters per second 

e. - 62.5"meters per second 



teach, est.: 51% 
stu.^score: '38% 



Panel comments^ Three of the four items testing recognition of measurement 
facts (objective 37), were related to metric units (e.<j.' kilograms as a unit ' 
of weight).' The student scores for all 'three items were higfter than the 
teacher estimates. v The student average score wa*s 83%, as opposed to an 
average teacher estimate of 67%. However, the student score, for computing 
millimeters from centimeters' (item ^6) was lower 'than the teacher estimate. 



-\ : •„. •- 14 . - , 20. 




* * * t 

The student scores' were highest for .objective 37 (average score: 73%), lowep 
for item.56 which was related .to objective 38 (score: 59%), and lowest for 
• objective 40 (average score: 47%),. It was hypothesized that students usually 
learn basic .measurement concepts, 'but do not solve measurement problems as 
successfully. A suggestion s was made to develop a test composed, of many 
measurement' items to identify specific student abilities and diagnose 
difficulties in measurement. ' 




Topic V: Algebra 

** 

The four ffest items on thfs topic measured comptrta^fpn in alqebra (objective 
42). Table 7 shows the results. V* m 



Table 7 



Objective 42: Computation in Algebra 



Item j57. If x is. replaced by'3,~tinrii the value. of. 
x? - 1 is • 

a. 8 

b. 11 teach, est.: 69* 
c^ !> 1 ^ stu. score: 73% 
d. 2 



Item 58. Solve the following'equationf, 

4 \ ' * : t 

3x - 3 « 12* '< . - 
x - 

a. 15 ".*••»» * 

b. 5 teach, est.: 67X 

c. 3 stu. score: 71X 

d. 9 y 



Item 59. (4x - 2) (x - 5) => 

*■ . 

a. • 4x + 2 X x - 5 , . , 

b. "4x2 . i 8x . iQ l>. te |f ch . estt . 51,5 
ci 4x - 10 ' ' stu. score: 51% 
d. 4x + 2x - 3 



Item 35.' The solution set of the equation x 2 = 9 1s 



a. (31 

b. (-3) ' ' teach, est.: 60% , § 

c. (x*3) stu. score: 41X 

d. ,1-3,3) . 



' '.'22 % 

- 16 - 



4 



Panel comments ; The student scores approximated ^he teacher estimates, for 
three of the four items, and for objective 42 as a whole (student average 
score: 59%; teacher estimate: 62%). 

The student score for i t£m 35 was lower than the teacher estimate/ S&veral 
panel members hypothesized that less than 50% of Illinois students take 
algebra before the end of high school. That hypothesis was supported by two 
sets of data. Twenty percent of the teachers *1n the HEP survey indicated 
that their students had received little or nf exposure to the material tested 
by objective 42. Further evidence supporting the hypothesis is contained in 
The Illinois Census of Secondary School Course Offerings (1977 ). 1 Data from 
the survey indicate that only 12.46% of high school students and 6-03% pf 
junior high scho'ol students took elementary" algebra during the 1976-77 school 
year. A conservative estimate from these figures ^would be that 50-60% of 
Illinois students have not taken elementary algebra by ttfe end of high school. 



s 



m ^ 

«r / 



• 1 The Illinois Census of SecondaryiSchool Course Offerings . Springf ieVd, 
Illinois 6277.7: Illinois State Board of Education, 1977. 

> # 
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Topic VI: Geometry 



The test contained one item # on t'he uffiterstanding °of geometric concepts 
(objective 47) and two items on problem solving in* geometry (objective 
Table 8, shows the results. ■ 



Table 8 



Geometry Items and Results 



, Objective 47: Understanding Geometric Concepts 



, Item 63. Which is true? • 

a. All rectangles are squares. ' J 

6. All squares are, rectangles . teach, est.: 4$% 

~c~. No squares are rectangles. stu. score: 38% 

d. No rectangles are squares. 

e. ^one of the above. 0 



. Objective 48: Problem Solving- in Geometry 



Item 61.. In a $iven triangle, the measures of two of 
the angles are 60 degrees and 70 degrees. The measure 
> of the third angle is 



a. 50 degrees. . 

A b7 60 degrees. teach, est.: 56% 

c. \2Q degrees.. stu. score: 60% 

d. 90 degrees. 

e. 130 degrees. 



24 

- 18 -' 



Item. 64. If the measure of Angle F is 50° and the 
measure of Angle 6 is 105<Vlthat is the measure of 
« Angle E? ^ 




E 



a, 25° •> .• 

bT 35°. teach, est.: 56% 

c. . 55° " stu. score: 56% 

d. , 180° .... 



Panel comments : The student scores were higher for the problem 
solving items' than for the item requiring understanding of a 
geometric concept. The student scores (average score: • 58%) A t 
approximated, the, teacher estimates (average estimate: 56%) f the 
problem solving items, but the student score was lower^than the;* ' 
•teacher Estimate for the item related to conceptual understanding. 
Several panel members hypothesized that less than 50%, and perhaps 
less than 33%, of Illiribis students take a course in. plane geometry 
before the end of high school. That hypothesis was supported by two 
sets of data. Twenty- seven -percent of the teachers in the HEP 
suryey reported that their students had received little' or no. 
exposure to the material • tested by the geometry items. The data- of 
The Illinois Census of Secondary School Course Offerings (1977)*= 
indicate that only 7.85% of Illinois High School Students and 0.39% 
of Junior High students were enrolled in a plane geometry course 
.during the 1976-77 school year. A conservative estimate would be 
thatfi0-7O# of Illinois students do v not. take plane geometry before 
•the end of'' high school. . * > 



' v.. 



S 



2 The Illinois Census of Secondar, v% ool CourSe Offerings. 
Springfield, Illinois 62777: Illinois §tate Board of Education, 
1977. • ' ' w... - * 
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Topic VII: Probability and Statistics 



The test contained one item' on this topic. Students were required 
to compute simple statistics presented in a taplje*) Table 9 shows 
the results. * , \, < 



Table 9. 



five 50: Computation with Statistics . 



'Number of Telephones in Operation in Various 
World Areas in 1§68 (0=8 million telephones) 



Area" 


Number of Telephones 

«* 


North America 


000000,0000000000 


Europe 

J- 


oopoooocfoo 


Asia 


0000 





Item 46; According to the chart, in 1968 thet number 
of telephones in operation. in north America was how 
many times the number of telephones /in, operation in. 
Asia? • r 



a. 3 times as many 

b. 2 times as many 

c. 5 times as many 

d. 4 times #s many 



teach, est.: 65% 
stu. score: 70%* 



n \ 

20 - 



26 



PaneL-comments : The student score approximated the teacher estimate. 
Thirty-three percent of the teachers reported 1n the HEP survey that their 
Students had received little or no exposure to the material tested by this 
Item. 



Topic VIII: Personal and Consumer Mathematics 



Eight items tested this topic. All of them measured problem solving related 
to personal and^consumer situations (objective 56)/ Table 10 shows the item 
results. " * 



Table 10 



Objective 56: Problem Solving in 
Personal and Consumer Mathematics 



Item^7. John's parents bought a refrigerator for 
$375. If they pay $20 per month for two years, how 
much more than $375 will the refrigerator cost them? 



a. $ 95 
b< $105 
1200 



c. 
d. 



teach, est.: 68# 
stu. score: 80% 



$375 



Item 43. Television sets are on sale at two stores. 
One offers a 10 percent discount ,.while the other 
offers 15 percent. WhffT is the difference in dollars 
in the sale price at the two stores, of a TV- set that 
is regularly priced at $100? 



• \ 



a. 



$ 5 

c. $15 

d. $25 



teach, est.: 6395 
stu. score: 78% 



J 



Item 48. An automobile can be bought for cash for 
$2,850 or on credit with a -down payment of $400 and 
$80 a month for three years. How much MORE would a 
person j>ay by buying on credit rather than by buying 
ttfe car for cash? h 



a. 
b. 



; $400 
$430 



d. 



1450 
$470 



teach, est.: 63*5 
stu. score: -74/15 



27 
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Item 44: In a school election with three candidates," 
Joe received 1?0 votes; Mary received SO votes, and 
George received 30 votes . What percentage of the 
total number of votes did Joe receive? * 



a. 40% \ 

b. 50* ' teach, est.: 56% 

c. 60% stu. score: 69# 

t. — m 

ftem 49. Cloth fs'sold by the square meter*. If six 
square meters of cloth cost $4*80, the cost of 16 
square meters will be 



a. $12.80 

V. $14.40 teach, es't.:' 53% 

c. $28.80 stu. score: 69% 

d. $52.80 

e. $128 



Item 42. Tom bought a bicycle last year for $70. 
This year the same model 1s selling for 10% more. 
What 1s the price of the bicycle this year? 



a. $77 

V. fflS teach., est.: 65% 

c. $82 stu. scor.e: 66% 

d. $87 



Item 39. A door-to-door salesperson receives 2(^ 
percent of the retail' value of his/her sales as 
commission. What must his/her total retail sales be 
1f he/she 1s to earn a commission of $60? 



a. $120 

b. $200 ♦ ■ • teach, est.: 53* 

c. $£50 * stu. score: 57% 

d. $300 



Item 51. The price of an article was $100. The price 
was first raised by 10% and was then reduced by 10% of 
the new price. What 1s the price* of the article now? 



a. $90 

b. $99 i * teach, est.: 50* 
T. $100 stu. score: 31% 

d. $101 ' 

e. - $na • 
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Panel comments : The average student score (66%) approximated the average 
teacher estimate (59%). ■ Panelists noted that*"the range of scores was quite, 
•large, - from 80% for item 47 to 31% correct for item 51. > It was suggested 
that research needs to'be done regarding how student success is affected' when 
items are highly relevant to their everyday lives vs. when items are less 
relevant. One hypothesis could be that the more relevant to everyday life a 
problem'is, the more successful students will be in solving it. 

Another suggestion was* that research is necessary regarding student abilities 
to work with percentages. Scores on percent items were 78% (item 43),* 69% 
(item 44), 66% (item 42), 57% (item 39) and 31% (item 51). Why was the range 
of scores so large? -Do students understand the concept of percent? Do they 
know the mechanics for working with percentages? What instructional 
approaches are most helpful to engender developed abilities in percent? 



Chapter 3 
i 

Discussion of the Results 



THe" mathematics panel was asked to reflect upon and discuss the results of the 
1979 test* Their comments were based primarily on the following sources: 1) 
th£ performance of 4th, 8th and 11th grade. Illinois students on the 1976, * 
1978, and 1979 HEP mathematics tests, 2) the JIEP* teacher surveys. 3) The 
Illinois Census of Secondary School Course Offerings T1977) , and 4) the 
findings of mathematical and educational research relevant to the HEP. % 

Two major competing hypotheses were explored by the 1979 eleventh 'grade HEP: 
1) that there would be three ability factors or, 2} that there would be six . 
topic, factors* Additionally* it was hypothesized 3) that' the teacher 
estimates would be -higher than the student scores for the items loading on ( \ 
Whatever ffrc,tor(s) emerged and, 4) that the teacher estimates would be higher 
than the student scores for the items that tested the six objectives which 
were measured* * 

Neither of the first two- hypotheses was supported. Factor analysis revealed 
one factor, which could probably be called a general mathematics factor. 
Comparison with the 4th and 8th grade HEP factor analysis results led to the 
hypothesis that the emergent faGtor might be labeled "previously learned 
mathematics," and Was more likely to be an ability factor thart a topic 
factor. It was suggested that future/IIEP tests try to identify constructs * 
which may relate Jto the ^learning- of mathematics. 

Hypothesis 3 was' not supported. Teacher estimates were not significantly 
higher than student scores for Factor I. ■% 

Hypothesis 4 was, supported for objective 14 (computation with fractions) and 
objective 40 (problem solving ir> measurement), but not for the other four 
objectives which were measured. Teacher estimates for objectives 10 and 14 
were significantly "higher than student scores. Correlations between the two 
.were also* significant (r .81 for objective 14 and r .66 for objective 40). ■ 

Mathematics scores on the tlEP were higher in 1979 than in 1976 as a whol^e, 
(see the 1979 HEP : Annual Report for^the trend data). Trerids were analyzed 
for mathematics in, general, and that was- an excellent beginning.- ,A 
' recommendation for the future was that hypotheses be tested regarding Jirends 
for specific mathematical abilities, topics, and/or Objectives. The base line 
data is contained in the 1976, 1978, and 1979 HEP tests. Have the curricular 
emphases of the past four or more years brought about imprQve'd student * 
performance in specific abilities such as computation or 4>ecific topics such 
as geometry? In the future' the HEP should focus on narrower areas within 
mathematics and test hypotheses about where Improvement is occurring. . Such an 
approach could indicate where students are improving and where changing, 
curricular emphases are effective. Sourid tests in the specific areas could be 
developed. Such a "test bank" would,* in itself, beVgreat benefit. The 
knowledge gained about students from those tests would be an even greater 
benefit. * , 

30/ 



Chapter 4 



Factor Analysis Results 



The HEP was first administered in 1976. Results from the test gave base • 
line data regarding mathematics achievement, In 1978, the objectives were- 
revised in terms that were more easily understood and more amenable to 
research on learning processes as they occur in students. Results were 
subjected to factor analyses, a statistical procedure which helps identify 
student abilities and strategies used in learning. _ 

^ . . ' t ' ' 

Factor analysis is a highly technical mathematical and statistical procedure 
which cannot be fully explained here. However, an intuitive understanding 
of factors and their derivation is possible.' Fred Kerlinger, in his book 
Foundations .of Behavioral Research (1973) wrote: 

Factor analyses is a method for determining the number and nature of the 
underlying variables among large numbers of measures. . 

Generally speaking, if two tests measure the same thing, the scores 
.obtained from them can be added together. If, on- the other hand, the 

two tests do not measure the same'thing, their scores cannot be added 
.together. Factor analysis tells us, in effect, what tests or measures , 

can be .added and studied together 'rather than separately. -It thus. 

limits the variables with 'which the scientist must cope. It also 
. (hopefully) helps the scientist to locate and identify unities of 

fundamental properties underlying tests. and measures. 

A factor is a construct, a hypothetical entity that' is assumed to 
'underlie tests and test performance. A.number of factors have been 
found to underlie intelligence, for example: verbal ability, numerical 
ability, abstract reasoning, 'spatial reasoning, and memory. 

A HYPOTHETICAL EXAMPLE lj * 

Suppose we administer six tests to a large number of seventh grade 
pupils. We suspect that. the six tests are not measuring' six, but some 
smaller- number of variables. The 'tests are: vocabulary, ^reading, 
synonyms, numbers,, arithmetic (standardized tests), and jar&thmetic 
(teacher-made tests). The names of the.se tests indicate their nature. 
We 'label them respectively, V, R, S, N, AS,. AT. (The last tWo tests, 
though both arithmetic^; have different contents and reliabilities. We 
assume a good Reason for including them both in a test battery.) After 
" the tests are administered and scoisHd, coefficients of correlation are 
computed between each test and «every. other test.' We lay out the r's in 
a correlation .matrix (usually ,cal-led R matrix). The matrix is.given in 
Table 37.1 (Table 11). 



TABLE 37.1 R MATRIX: 







V 


R 


S 


N 


. AS 


AT 




V 






.63^ 


) .09 


^oK 


.00 


Cluster I 


R / 


<72 




.57^ 


.15 


.16 


.09 


s 


.63 


.57^ 




.14 


.15 


.09 




N 


.09 


.15 


■14 . 






.63 




AS . 


.09 


.16 


.15 / 






.72, 




AW' 

Al 


.uu * 


.uy 


.uy l 


.bo 


















Cluster Ij[ 
















■ \ 




V 

















...How many underlying variables or factors are there?. . .The ' 
factors are presumed to be underlying unities between the test 
performances. They are reflected in the correlation coefficients. 
If two or more tests, are substantiate correlated, then the tests 
, share variance. They have common factor variance. They are 

. measuring something in conation. ' • 

...There are two factors. Jhis is Indicated by the clusters of r*s 
circled and labeled I and II in Table 37.1. Note that V correlates 
with R,.72; V with S,. 63; and R with S, .57. V, R, arid 5 appear to 
be measuring something in common. It is important to note, 
however, that the tests in Cluster I, though "themselves 
" inter correlated, are not to any great extent correlated wi£h the 
/ tests in Cluster II.. Likewise, N, AS, dnd AT, thDugh themselves 

inter cor re la ted, are not substantially correlated with the tests V, 
R/ and S. What is measured in common by the tests in Cluster I is 
evidently not the same as what is measured in common by -the tests 
in Cluster II.. There appear to be two clusters or factors in the 
-matrix/ (pp. 65^-661) .3 

For further discussion of factor analysis, see Kerlinger (1973) pp. 659-692 
and cited references. * 



: m 

3 Fred H'. Kerlinger. Foundations of BehavibraT Research (2nd Edition). 
New York: Holt, Rineh^rt,* and Winston Inc.,- 1972. 
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Results for Factors and Hypotheses 



Hypothesis 1 stated that four ability factors would be indicated. The 
hypothesized factors were: 1) recognition of mathematical facts, 2) 
computational skills, 3) an understanding of concepts^ and 4) problem 
solving'- ability.. The data showed one factor. 

The fourth and eighth grade* data had indicated two factors. See Fourth 
Sra'de Mathematics Results of tne 1'979. Illinois Inventory of Educational 
Progress^ and Eighth Grade Mathematics Results of the 1979 Illinois 
Inventory of Educational Progress . In each case one factor was comprised 
of items that required students to 'deal successfully with "previously 
learned material," and the- other factor was comprised of items that. required 
students to do "problem solving which required original thinking." The 
eleventh grade factor was comprised of items that required students to deal 
successfully with "previously' learned material." 

Hypothesis 2 stated that there would be seven topic factors, one factor for 
each topic which was measured. The hypothesis was not supported. No topic 
factor was indicated. ' 

Hypothesis 3 stated that the teacher estimates would be higher, than the 
student scores for the factors; The hypothesife was* rjot supported. Table 12 
shows the results. 



"V 




^Fourth' Grade Mathematics Results of the l979;mino1s Inventory of 
Educational Progress ./ Springfield, Illinois 62777: Illinois State Board 
of Education,, 1981^/ ■ 

5£ighth Grade Mathematics Results of the 1979 Illinois Inventory of 
Educational Progress . Springfield, Illinois 62/77: Illinois State Board 
of Education, 1981. , ' • 
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Objective 
10 



Table 12 
Factor I: Learned Material 



Item 

25 
■34 



Teacher 
Estimate 

81* 
78* 



28 



34 



Student 
Score 

80* 
77* 





. 24 


86* 


73* 




* 36 


67* 


72* 


14 


33 


83* 


75* 




29 


83* 


' 74* 




28 


74* 


72* 




31 - 


74* . 


55* 




.3Q 


69* 


• . 41* 


15 


40 ^ 


70* 


. 52* 


28 


37 . ' 


72* 


■ 66* 


30 


26 


70* 


63* 


31 


27 


' 74% 


70* 


32 


38 


64% 


82* 


37 . 


53 


67% 


88* 




v 54 


, 70% 


84* 


\ 


\ 55 


63% 


-76* 


\ 62 


59% 


42* 


.38 


\56 


70% 


59* 


40 


\ 


$6% 


54* 


■ 


6<J 


51% 


51* 




$ * 


56% 


48* 




49 , 


53% 


44* 




52 


51* 


38* 


JO 

42 


57 


69* 


73* 




58 


67* 


71* 




59 


51* 


51* 




35 


60* 


41* 


50 


46 


65* 


70* 


56 


47 


68* 


80* 




43 


63* . 


78* 




48 


63* . 


74* 




44 


56* 


69* 




49 


53* 


. 69* 




42 


65* . 


66* 




39 


53* 


57*- 




51 


50* 


31* 


Mean 




.66 


.63 


Standard Deviation 


.10 


.15 


N 




38 


. 38 


t « .843+ 


df » 74 


r 2 « .004 








•- 


* 



Hypothesis 4 stated that the teacher estfmates would be higher than the 
student scores for the items of the six measured objectives.- The hypothesis- 
was confirmed for objective 14 (computation with fractions), and objective 40 
(problem solving in measurement), but not for the' other Tour objectives. The 
degree of difference between the teacher estimate -and student performance is 
illustrated by the size of the r 2 . Table 13 shows the results.- 



- Table 13 

•T-test Results for Specific Objectives 
Objective Teacher Estimates Student Scores 

T-test 





Mean 


S.D. 


Mean 


• S.D. 


N 


results 


df, 


r2 


10 


.78 


.08 


.76 


.04 


4. 


. .57+ 


6 




14 


.75 


%07 


'.62 


. .14 


6 


2.07* 


10 


.21 


37 


.65 


.05 


.73 


' .21 


4 ' 


-.70+ 


6, 




40 


.55 - 


.06 


.47 


.06 


5 


2.03* • 


8 


,31 


42 


.62 


.08 


.59 


.16 


4 


.34+. 


6 




56 


.59 


.07 


.66 


• .16 


8 


-1.16+ 


l4 


.02 



♦significant at p<.05 level 
+ N.S. 



Additional Analyses 



In order to identify hypotheses for future, research*, post hoc analyses of the 
data were done. Correlations were computed between teacher estimates and 
student scores to explore the relationship between the two. This was done for 
the factor as a whole and for ;each* measured objective,. 

« * 

All resulting correlations, except for objective 10 (computations wjth whole 
numbers), were ^signif icant. The degree to which student performance was 
3tcotmted-£or v b^ the teacher -estimates can be seen from the size -of the r*. 
Table 14 shows t*he resets. * * 



Table 14 



Teacher Estimates Correlated with * 
Student Scores! by Factor and Objective 
for the 1979 Eleventh Grade HEP 





r 


df 


r2 


FACTOR -I 


.54*** 


74 « 


.29 


Objective 10 


.36+ 


6 


, .13 


Objective 1*4 ■ 


.81** v 


10 


.66 


Objective 37 : ' 


.88*** 




* .77 


Objective 40 


.66*' 


8 


.44 


Objective 42 


.74* 


*6 . 


.55 


Objective 56 


.75*** 


14 ' 


.55 


* significant p < .05 






** significant p< .01 






*** "significant p < .001 


' 6 




+ N.S. * 
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T-tests were, computed to test for significant differences among objectives. • 
Three significant differences were found. Scores for problem- solving in 
measurement (objective 40) were significantly lower than scores for ■ 
computation of whole numbers (objective 10), recognition ofjneasurement facts 
(objective 37), and problem solving in consumer mathematics (objective 56). 
The d(?re< of difference can be seen by the size of the r z . The difference 
•between student performance on objectives 10 and 40 is particularly strong 
(r = .88). Table 15 shows-the results. 



Table 15 



y 



y 



T-test Results for Objectives Measured 
by the 1979 Eleventh drade HEP 



Obj. 


Mean 


S.D. 


N 


Obj. 


Mean 


S.D. 


N 


t 


df 


r2 


10 


.76 


.04 


4 


14 


.62 


.14. 


. 6 


1.88+ 


8+ 


.21 


10 


.76, 


' .04 


4 


• 37 


.73 


.21 


4 


.28+ 


6+ 




10 


.76 


.04 


4 


40 


'.47 


.06 


5 


8.07** 


7** 


.88 


10 


• .76 


.04 


4 


42 


.59 " 


.16 


4 


2.06+ 


6+ 


.25 


10 


.76 


-.04 1 


4. 


56 


.66 


.16 


8 


J. 7+ 


10+ «, 




37 


.73 


.21 . 


4 


14 


.62 


M \ 


6 


.98+ 


8+ 




37 


.73 


.21 


4 


40 


■ .47 


.06 


5 


2.63+ 


7* 


.40 


37 


.73 


.21 


4 


42 


.59 


.16 


4 


1.04+ 


6+ 


.01 


37 


.73 


• 21 


4 


56 


.66 


.16 


8 


.61+ 


10 




56 


.66 


.16 


8 


14 


.62 


.14 


6 


.50+ 


12+ 




56 


.66 


.16 


8 


40 


.47 


.06 . 


5 


2.55* 


11* 


.30 


56 


.66 


.16 


8 


42 


.59 


.16 


4 


.74+ 


10+ 




14 


.62 


.141 


6 


40 


.47 


.06 


5 


2.24 


9+ 


.27 


14 


.62 


.141 


6 


42 


.59 


.16 


4 


.32 


8+ 




42 


.59 


.161 


4 


40 


.47 


.06 


5 


1.60+ 


7+ 


.15 



♦significant p < .05 
** significant p < .001; 
,+ U.S. 
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APPENDIX A 

iyOEX OF MATHEMATICS OBJECTIVES 
FOR THE 1979 ELEVENTH GRADE HEP 



Objective 


Item 


Page 


' 10 


24 


6 


10 


25 


6 


10 


. 34 


6 , 


10 


36 


6 


14 


" 28 


7 


14 ■ 


29 


7 


14 


31 * 


7 


14 


33 A 


7 


14 


30 


8 


14 


32 


8 


15 


40 


8 


28 


37 


* 9 


30 . 


26 


- 10 


31 


27 - 


10 


32 


38 


11 


37 


53 


12- 


37 


54 


12 


37 


55 


' 12 


- 37 


62 


. 13 


38 


" 56 


13 


40 


' 41 


13 


40 


45 


14 


40" 


50 


14 


40 


52 


14 


, -40 


60 


44 


42 


35. 


16 


42 


57 


16' 


42 


58 


16 


- 42 


59, . 


16 


47" 


63 


ia 


48 


61 


18 


48 


64 


19 


50 


46 


20 


56 


43 


21 


56 


47 


21 


56 


48 * 


21 


56 


39 


22 


56 


. 42 


22 


56 ' 


44 


22 


56 


49 


22 


56 


51 - 


22 
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APPENDIX B ' • ' 

INDEX OF MATHEMATICS ITEMS \ 
FOR THE 1979 ELEVENTH GRADE. HEP 

Item Objective ' Page' 



24 


• 10 


6 
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